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Abstract A decidable transfinite hierarchy is defined by assigning ordinals to the pro- 
grams of an imperative language. It singles out: the classes TIMEF(n'^) and TIMEF(nc); 
the finite Grzegorczyk classes at and above the elementary level, and the S^-IND fragments 
of PA. Limited operators, diagonalization, and majorization functions are not used. 

1 Introduction 

1 Motivation Most transfinite hierarchies are defined in two steps: a sequence 
Za of majorization functions is introduced by means of a recursive operator at 
successors, and, at limits A, by a diagonalization of the form Zxin) = Zxin]{n); the 
class of functions is then obtained by closure of Za + U/3<a 2^/3 under limited PR 
or product, and substitution (often limited too). The rate of growth of such Za is 
either slow to the point of dispersing a single class like TIMEF(nfc) along an w^-type 
segment; or fast to the point of ignoring the complexity classes. 
The Implicit Computational Complexity (ICC) program is looking for characteriza- 
tions: (a) obtained by closure under resource-free (that is, unlimited) schemes of a 
small stock of basic operators, not including ad hoc functions; (b) whose membership 
should be decidable syntactically. For example, Cobham's polytime disagrees with 
(a) because of the smash function; and with (b) because limited PR on notations is 
un decidable. The same applies to the role of Z^ and of the limited schemes in the 
transfinite hierarchies. 

ICC was also dubbed predicative, on the grounds of the analogy, pointed out by 
Leivant, between growth of sets and impredicative comprehension, on one hand; 
and growth of functions and nested recursion, on the other. Like in other branches 



of mathematics, impredicative recursion can be reduced by means of constructions 
by stages: at a, only functions introduced at stages P < a can be used. How to do 
this is less easy at limits A than at successors. A first solution is using enumerators 
e G ^<A, to put f & Z\ for any / such that (Rogers notation) 

f{n) = Lpein){n) provided that (fe{n) e Z^x- 

Membership is then undecidable, because of the condition about ipe{n)- Moreover, a 
natural way to compute Zx is via the form Lpi = Lp^H) of the recursion theorem. But 
then a function apply is needed, and it is not clear to which stage does it belong. 
In last decade we have been trying to collect and connect, in a same taxonomy or 
hierarchy, built-up by means of a same predicative criterion, as many complexity 
and subrecursive classes as possible. In our contributions to four ICC workshops, 
and elsewhere [O ICZGj , a number of hierarchies were introduced, covering the PR, 
the elementary, and the exponential time classes. These exercises were based on 
constructive forms of diagonalization, based on linear time enumerators. Apply-like 
functions were not used, but membership was undecidable in these cases too. 

2 Statement of the result In this paper an imperative language is defined by 
closure of a generic stock of constant time programs under composition and under 
a new repetition scheme (see ^lOj) . A hierarchy {a < Sq) is defined by assigning 
tree ordinals (see |FWj ) to its programs. It singles out at u'^ and ujc the classes 
TIMEF(n'^) and TIMEF(nc), and, at higher ordinals, the functions provably total in 
systems like PA. Besides harmonizing small and big classes, this hierarchy is predica- 
tive, decidable, by closure under unlimited operators, and it doesn't use any form of 
diagonalization. The language is built-up without making use of majorization func- 
tions; the Wainer-Schwichtenberg functions enter the scene later, to play the role of 
uniform scales against which we can measure the power of its decidable fragments. 

3 Theorem We have (TIMEF(/(n)) ^ Cq, means that Ca sandwiches between 
TIMEF(/(n - 1)) and TIMEF(/(?2 + 3))) 

Polytime TIMEF(ri'=) = (c > 1) 

Superexponential time TIMEF(?2c) ~ C^^ 

Grzegorczyk classes TIMEF(Fc+2(^)) ~ C^'^+c 

2-nested recursion TIMEF {F^c+d{n)) ^ C^^{c+i)+<i {d > 0) 

Higher classes TIMEF(F„(n)) ^ C^a (u;^ < a < £o)- 

See for a more precise definition of Ca and TIMEF(/(?7.)); see El for the Wainer- 
Schwichtenberg functions Fa, and see 1211 for the proof of this theorem. 
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4 Related work A harmonization of the computational complexity hierarchies 
with the subrecursive ones, in terms of imperative programs, appears to be lacking. 
Moreover, we are not aware of other imperative languages for the whole class of the 
provable functions which replace diagonalization by a finite number of schemes. In 
proof-theoretical terms, we have [Lj and the extension of |FWj to the small classes 
contained in |UWj . 

Polynomial time is associated with programs whose repetion nesting depth is 1. 
The scopes of their repetitions are iterated for a number of times equal to the input 
length. In this way the distinction between nested and un-nested repetitions mirrors 
the distinction |BCj between safe and ordinary variables. 

The hierarchy can single-out the super-exponential classes because the repetition 
scheme is quite honest: runtime for the simulation by TM of f{n) is f{n + 3) (in 
literature one finds 2-^(-^(")) in [FWJ and 2^("+l°l) in jW|). 

2 The Language 

5 Syntax Let a class D of data be given, together with an appropriate measure 
|x| of the length of all a; G D. Let A denote a generic, finite collection of initial 
programs, defined on D. To avoid tedious analyses of marginal cases we assume 

(a) |A(x)| = |x| + 1 for each A G A and a; G D; 

(b) each A G A is simulated in a constant time by a TM; 

(c) \x\ > 2 for all x. 

Define a class A* of programs by closure of A under the composition and repetition 
schemes 

QR (Q) (Q,RgA*). 

A program is acyclic if it is a composition of initial programs; c will denote a 
composition of c initial programs (so we always have 1 G A). A program is safe if 
its repetitions (if any) don't occur in the scope of other repetitions. 

6 Notation i, . . . ,q are numerical variables, while c, . . . , e are numerical para- 
meters. P,. . . ,T are programs, and A, B,. . . are initial programs, e is the empty string 
over the current alphabet, or it is the absent program. P° is e, and P'^^^ is P'^ P. 
a,p,. . ., and X, fi are (resp.) tree-ordinals, and limits. ao[P] is P, ac+i[(3] is a^'^t^l, 
and cVc is OcH- So a2[3] is a" , and ai is a". 

Throughout this paper, n is the length of the current x, and / > 3 is t?, -|- 1. 
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7 (1) The length |P| of P is the overall number of its initial programs and repetitions. 

(2) The depth A P of P is the nesting depth of its repetitions. 

(3) Define the tree ordinal (see |FWj ) oP of P by 



o e 



0; ol = l; oQR=oR + oQ; o{Q)=u°^. 



Soo(l)(2) =u^ + u; ol((2)) = o;^' + 1; and o = uj^+^"+\ 

For all tree-ordinals a ^ and (3 ^ we have 

(a) a is in Cantor normal form iff a < ^o! (b) a, P < a + P and a < cj". 

By (a) a program of the form P Q with P stronger than Q (in the sense that oP > oQ) 

does not interfere with our hierarchy. By (b) an induction on oP is tantamount to 

an induction on the construction of P. 

Notation |oP| = |P| (that is |a| = |P| iff a = oP). 

8 Any program P is either in the form A S or in the form 

((. . . ((iQ)Ri) . . .)Rc) S (c>0;Q, S, and any Ri may be e). (A) 

Hence we may define the normal parsing of any P (not acyclic) by 

P = d ("^(1 Q) U (d, c > 0; Q and U possibly absent) 

where U is a string over A U {(,)} which is not necessarily a well formed program. 
For example, in the normal parsing of ((2)) we have d = 0, c=l,Q=l and U =). 

9 Semantics An instantaneous description (id) is an expression D of the form 
P : z. Next rules take any ID into the next one (c > 0; A, Q and T are not absent) 

R-eduction 
uj- elimination 
(ARt^I) A-pplication 
(At = 1) safe P-ostponement 

The computation C(P,a;) of P on a; is the sequence 

Dq = ? : X, . . . , e : y = Dp (Di ^ A+i for all i < p). 

Notation (1) D D* means that there is a (sub) computation of the form 
D, . . . , D*. P(x) = y stands for P : x ^ e : y. 

(2) For any numerical function /(n), P(a;) =c f{n) is short for |P(a;)| = n + f{n). 
So, we may now write clause |Hf a) in the form A(x) =c 1 (or, by abuse, A : x =c 1). 



(^(AQ) U 


: X - 


^ {'{qY u 


: X 


m u 


: X - 


(^a' u 


: X 


AR 


: X - 


R 


: A(x 


AT 


: X - 


TA 


: X 
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10 Comment The leftmost repetition (AQ) of any program P is processed first, 
and replaced by / copies of a less complex program, namely by: (Q)' if Q is not 
absent; and A', if Q = e. Assume that, after unnesting of some repetitions, P has 
been reduced to the form (A) R. By rule u we obtain A' R. At this point, if R is not 
safe, rule A is applied I times and the length of the intermediate result is doubled. 
On the other hand, if R is safe, rule P delays any change to x until all repetitions 
have been unnested. In this way we keep x safe in the sense of |BCj . and we ensure 
that all iterations are repeated for a number of times that equals the input length. 
If we have P = S T then S is processed until it vanishes (if T is not safe) or until it 
has been reduced to a postponed acyclic program. So we have 

ST : X ^ T : S{x) if T is not safe; S T : x ^ T p : x and S(x) =c p if T is. 

11 Example We have 

1 (1) : x 

2 (1)'^ : X 



=^ 1 : X 


(rule) uj with U = e and c = 


=c I 


A [l times) since A i = for all i 


l{iy-^ : X 
=^ {ly-^ 1 : X 


UJ with U = (l)"^^^ 
P (/ times) since A (l)'^"^ = 1 
UJ and P since A (l)'^"^ = i 


^ {iy-^1^ : X 


=^ ... ^ 1'^ : X 


=c dl 


A for dl times since Ai = for all i 


{ly : X 


R with Q = 1 and U = e 


— c t 


part 2 with d = I. 


{1) : X 


UJ, with c=l, Q = U = e 




because the 



3 (2) : s 

forthcoming Lemma QUI will generalize part 3, by proving {d){x) =c l'^. 

12 Lemma If rules R or u take P into P* and oP = A < £o then oP* = A„. 

Proof. Assume that P is in the form lHtjX]) with 

oQ = 7; oRi = (3i; oS = a. 
Case 1. Q ^ e. We then have P* = ((... ((Q)'Ri) . . .)Rc) S, and 

\ = a + uj^^^'^'" ; oP* = a + cj^^+^''' = A„. 



Case 2. Q = e. We then have P* = ((. . . (l Ri) . . .)R<,) S, and 
X = a + u^^+^'" ■ or = a + uj^^^''"' = Xn. 
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13 The Hierarchy Define ([P] is tlie function computed by P) 

C = {|P] I P e A* for some A}; 
C = meC\oF<a}. 

Notation TIMEF(/(n)) is tlie class of all functions 99 : D i-^ D (for some D) that 
are TM-computed in deterministic time 0{f{\x\)) for all x G D. 

14 Recall that the Wainer Schwichtenberg majorization functions are defined by 
F,{n) = 2n + 1; F„+i(n) = F^+^n); F^{n) = F^^n). 

Claim We have (c > 2; / > 3) 

(a) F2{n)=2H-l- (b) F^{n) Kl,- (c) (/ + 2)^ < ^3(0. 

Proof, (a) We show Ff (n) = 2^;-l. Induction on c. Step. ^ 2(2^;-l) + l. 

(b) One may believe this by a few computations for n = c = 2; and by noting that 
2"?7, grows less than 2"+l"l+^ while tj," grows like 2"'l"l (for n in binary). 

(c) We first show by induction on c 

(/ + 2),<2,[/2 + k]. (B) 

Basis. For / = 3, the assertion follows by computations; for / > 4 by observing that 
(/ + 2)'+^ grows like 2'l'l, obviously less than 2' . Step. We have 

(/ + 2)e+l <,H. {I + 2)^^[''+^'l <,i_ ,+2<2^ and c>l 2^^^''^^'+'^ < 2,^,f + (c + 1)/]. 

The claim now follows because part (a) gives i^2(0 — and, therefore, 

-^3(0 = ^2^^(0 > ^2(2^^) >part (a) I times 2i[2/^] jgj ^.^^ {I + 2)/. 

3 Simulations 

15 Simulation of TMs We restrict ourselves to TM M described by arrays of 
size q X k'^ whose elements m{i,o) are (d + l)-ples {i* , Ii, . . . , Id), with I < i* < q 
and —l<Ih'^k{l<h<d). The array says that M has q states and d tapes, 
infinite to the right, over an alphabet {iSi, . . . , iSfc}. If o is scanned in state i, M 
enters i*, and moves left/right or writes Si on (tape) h, according to cases —1,0,/ 
of //j. Expression Dxt = {hh,Oi,ri, . . . ,ld,Od,rd) says that, before step T of the 
computation on the input d-ple X, string IhOhfh is in h, and Oh is scanned in state i. 
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Take as D the {3d + 2)-ples of strings over T = {1, . . . , q, Si, . . . , Sk}, and let \x\ be 
the max among the lengths of the strings of x. Define a representation of Dxt in 
D by xxT = {i, h, oi, rf , . . . ,ld, Od, r^, l-^+l"^'), where is r read backward. Take as 
A the finite class of all combinations of de/constructors on F decided by the values 
of q and o. One of them is a program nxt^'^ taking any xxt into xx,t+i- Note that 
the last component of xxt ensures that we have |nxt*^(x)| = |a;| + 1. 

16 Simulation by TMs Given A, a TM Ma with t > 2 tapes over an alphabet 
C D A can be defined, which simulates all initial programs in 1 step (since their 
number is finite). Also, a TM with t + 3 tapes can be defined, that simulates 
any P G A* in the way outlined below. It uses: tapes 1, . . . ,t for rule A (via Ma), 
and for keeping all parsing operations in linear time; tapes B = t +1 and S = t + 2 
(resp.) for the initial programs postponed (according to rule P), and for the current 
program; and tape t + 3 for /, and for a flag F, which is set (cleared) if the program 
stored in S is (not) safe. 



('=(Q)'U; update F 

(^A' U; update F 

Q; apply Ma 

Q; B := B A end-while 



B:=e; S := P; 


I := \x 


+ 1 


assign F; 






while S ^ e do 




S = 


(^(QA)U 


then 


S : = 






s = 


(^(A)U 


then 


S : = 






s = 


AQ and F = 


then 


S : = 






s = 


A Q and F = 1 


then 


S: = 



apply B. 



17 Functions size and simulation runtime (1) For all a define the functions: 

(a) Ra{n), returning the time for the simulation of any P on x (oP = a); 

(b) ha{n) such that oP = a implies P(x) =c ha{n) (by induction on a one sees 
that ha is well defined, in the sense that oP = oQ = a implies |P(x)| = |Q(a;)|). 
(2) We claim that we have {0 < P; P + X < Sq) 



1 Rf3+m{n) = Rp{n) + m 

2 Rp+x{n) < Rp+^Sn) + m 

3 Rp+u.{n) < Rp{n + l)+l 

4 Rp+M < Rp{n) + 2l 



I) < R 



'/3+A, 



.(0 



if P>uj'' 
if P<iu'' 



We discuss line 2 only because the others are rather obvious. By working simul- 
taneously on all tapes, and by linear speed-up techniques, M^ can update F and 
produce / copies of a program shorter than |A| in /(|A| — 1) steps. By Lemma IT^ we 
may express this in terms of A and A„. 
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18 Composition lemma We have 

(IA) hp+-y{n) = ~h^{n + hj{n)) ii P > u'' 

(IB) h/3+-y{n) = hp{n) + h^{n) if /3 < u;" 
(2A) R/3+^{n) < Rp{n + h^{n)) + R^{n) < Rp{R^{n) + 1) if > a;" 
(2B) Rp+^{n) < Rp{n) + R^{n) li (5 < uj"^ . 

Proof. Immediately by the discussion at the end of^l (with oS = 7 and ol = (3). 
The second inequality of (2A) follows from our estimate Ra{n) > 2" at a > u'^. 

19 Lemma -F/3(n — d) < h^^ain) < R^^a{n) < Fp{n + e + 1) implies 

Fp^i{n -d) < h^c+i{n) < R^c+i{n) < Fp+i{n + 1) (rf, e < 1; /3 > 2; a > 

Proof. First half. Immediately by the strict monotony of all Fp, since n — d > 1. 
Second half. We first show R^a^^n) < F^in + c + e + 1). Induction on c. Step. 



< i?^.(F|(n + c + e + l) + l) l.H. 

< F/3(F^(n + c + e + l) + e + l) < F|+^(n + c + e + l) hypotheses 

Our assertion now follows because we have 

Ru.'^+i{n) ^2)2 RM^) <F'p{n + l + e + l)< F'+\1) < Fp+^{1). 
20 Lemma (Polytime) For all c > 1 we have 
r = h^.{n) < R^c{n) < l^ + lc^. 

Proof. We show by induction on c that we have 

hf3{n) + l' = hf3+^c{n) < Rp+^n) < Rp{n) + T + cH (0 < /5 < u^). 

Basis. One half bv fW lB). since rules ui and P give hf3^^{n) = hi^fs{n). The other 

half by[I7|;2)4. Step. 

hf3+^c+i{n) = hi3+uj<^i{n) rule R 

= hp^i^cnin) + l'^ l.H. with (3 + u'^n as (3 

= hp{n) + 11^ l.H. n times more, with (3 + uj'^i as (3. 

R/3+u.^+^{n) < Rp+^ci{n) + {c+l)l 1171:2)2 

< Ri3{n) + W + c^l + (c + 1)/ l.H. / times 

< Rp{n) + r+^ + {c+lfl. 
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21 Functions Size at the Elementary Level Define hc{n) = n + h^^u^{n). 
Lemma QUI with h(.{n) as botli c and / gives 

h^[n) = n + l^; K+i{n) = /i,(n)'^=(") + K{n) (C) 

To majorize he define a sequence of functions He by 

(/ tlirice, 1 + / for c — 3 > times, and 2 + / once). Thus for c > 3 we have 

Hc{l) = hlol for some g; iJc+i(0 = ^3[1 + for the same q. (E) 

For example, H^il) = ^[1 + 2] and H^il) = kil + 
Claim hc{n) < H^{1). 

Proof. Induction on c. Basis, c = 1. By ((01), since n + /' < To discuss next two 
cases of the basis, define L = + I'' + nl + n and note that 

L + 3 + l< /^+' + /' + 2/2 < + + /3 < < p+i, (F) 
For c = 2, we have by ((d), twice with c = 1 and c = 2, and (jFj), since n + l'- + 1 < 

/i2(n) < (n + + (n + /') < < < 

For c = 3, we have by (jd), case c = 2, and by (jFj 

Step. By © we have H^{1) = ^q] for some q. Hence 

where we have last inequality because 

{lM)i + h[q] = {ff + < f'"^' < f"" = hll + q]. 

22 Lemma (Superexptime) For all c > 1 we have 

Ic < K-,{n) < R^^cin) < (/ + 2),. 
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Proof. Both halves by induction on c. First half. Basis. Example ITTl 4 gives h^u,{n) = 
iK Step. By arguments like in proof of Lemma IT^ (with {n + l)i instead of Fp{n)). 
Second half. Basis. By Lemma EIH and 1171^2) 2 since we have 1^ + 1^ + 21 < f^K Step. 

Ru.^{c+i){n) < R^^{H,{n)) + R^.,{n) [IHi:2A), Claim ED 

< {Hc{n))i + Hc{nY + 2/ + R^u>c{n) like under the basis 

< (ifeH)i + ^cH^ + 2/ + (/ + 2)e LH. 

< 2('+2). ^ ^ + 2/ + (/ + 2), < (/ + 2),+i. 

23 Lemma (Gregorczyk classes) For all c > 1 we have 

Fc+2{'n) < h^^+c{n) < R^u.+c{n) < Fc+2{n + l). 
Proof. Induction on c. Basis. Rule R (with U = e) takes (1(1)) into ((1))'. Hence 

h^^+l{n) = ~K^l{n) >L.|221^« > ^2HL.[iniby[Ilb) = ^3(?^) 
R^^+An) ^2)2 ^--K^) + 3/ <L.|22l(^ + 2)i ^3(0- 

where, in the second last inequality, we can ignore term 3/ because neglectable with 
respect to the majorization at the end of last proof. 

Step. Rule R takes (lc(l)) into (c(l))', with o(c(l))' = u'^+H. The resuh follows 
by Lemma IT^ and I.H., with c + 2 as a; + c as a, and e = 1. 

24 Lemma (2-nested recursion classes) For all c > 1, and d > we have 

F^c+d{n) < h^u,(c+i)+d{n) < i?^^(c+i)+d(n) < F^c+d{n + 2) 

Proof. Induction on uo{c + 1) + d > uj2. Basis, d = and c = 1. 

h^^2{n) = h^u.+i{n) >i^,n^Fi+2{n) > Fi{n) = F^{n) 
Ruj-^ (^) %7l2)2 (^r<L. [2S1 -^'+2 {n + 2) = F^{n + 2). 

Step. Case 1. d = and c > 1. We have 

h^^{o+i){n) = h^^c+i{n) Fa;(c-i)+/(^) = F^cin) 

R^u^{c+i){n) ^Y7\2)2 Ru)^'=+l{l) <i.H. Fw{c-l)+lil + 2) < F^(c_l)+i+2(^ + 1) = Fujc{l + 1) 

Case 2. d > I. Rule R takes (ld(l)'=) into (d(l)'=)', with o(d(l)^)' = u'^^+'^l. The 
result follows by Lemma IT^ with uj{c — 1) + d as, [5 , uoc + d a.s a, and e = 2. 

25 Lemma (Large classes) u"^ < a < Eq implies 

F„(n-1) < /i^.(n) <Ru^4n) <F«(n + l). 
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Proof. Induction on a. Basis, a = u 



We have 



> F,„(n-1) = F^2(n-l). 



Lemma 121] 



^2)2 
Lemma |^ 



Step. Case 1. a is a limit A. 



h^x{n) = /i^A„(n) >jjj FA„(n - 1) > FA(n - 1) 



Case 2. a = 7 + 1. The resuh follows by Lemma IT^ with 7 as both f3 and a. 

26 Proof of the Theorem Inclusions of the form TIMEF(/g(n — 1)) C Ca- For 
each function G DTF(/^(n— 1)) there is a TM M in the form of ^15lthat computes Lp 
within fp^n — l) steps. Let nxt^^ denote the program whose ordinal is a and in which 
no other initial program but nxt*^ occurs. Our assertions follow by Lemmas 1201 122 
OHl 1241 and 1^ since: they state //^(^ — 1) < ha{n)] and since if A is the only initial 
program occurring in P, we obviously have P(x) = A'^°p'^"^(x). 

Other set of inclusions. The same lemmas show that the time complexity of an 
interpreter for language A* respects the asserted upper bounds. 
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